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ABSTRACT 

This paper highlights some of the issues concerning 
the transfer of Research and Development (R&D) Centers from th€ 
Office of Education to the National Institute of Education (NIE) . The 
problems of transition to the new policy and organization are 
discussed vith regard to program objectives and management and 
problems associated nith implementing fiscal year 1973 (FY 73) 

f und in g reguirementsv The issues considered iii^^^^ 

objectives are a) the need for specialized R&D centers^; b) th^ 
maintenance of a special relationship between Nil and HSD centers; c) 
NIE support of improvement in RGD management and technology; and d) 
achievement of a balance in policy conflicts regarding flexibility 
vs. continuity^ mission focus vs. conglomeration, and research vs. 
development. Program management issues discussed are a) coordination 
of policy implementation; b) completion of design of the assessment 
system for the new policy; c) budgeting, organization, and management 
of product dissemination; and d) the requirement that universities 
cost share in the support of R&D centers. Problems of implementing 
the FY 73 funding requirements are identified as being ccncerned 
with: a) consistency between funding recommendations a,nd program 
policy, b) the negotiation process, c) contract/grant terms and 
conditions, and d) the increased cost of the new policy. The author 
concludes that FY 73 should be considered a year of transition during 
which NIE carefully and deliberately moves to establish a lasting 
program. (HMD) 
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ISSUES RELATED TO THE TRANSFER OF THE R&D 
CENTER AND EDUCATIONAL lABORATORY PROGRAMS 
TO THE NATIONAL INSTITITTE OF EDUCATION 

I. Introduction 

This paper is being prepared at a time when legislation for establish- 
ment of the National Institute for Education (NIE) has been passed 
and the process of transition of educational R&D programs from OE to 
the new agency is beginning. The purpose is to highlight a number 
of issues concerning the Center and Laboratory Programs for the con- 
sideration of the new leadership. 

The paper accepts as given the framework zox a new institutional 
support policy as described by Charles Frye. That is, it is 
assumed that new institutions will be given institutional support 
only through their early developmental stages and that funding 
decisions will be keyed to the support of long term programs with 
specific end points once the institutions have reached maturity* 
We also assume that a major focus of management concern will be on 
the coordination of lab and center programs dealing with similiar 
educational problems. 



\l Charles Frye, "Management Policy for Institutional Support and 

Assessment," National Center for Educational Research and Development 
unpublished, February 9, 1972. 
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Durlng the past year two teams of outside experts formulated designs 

for an assessment system keyed to the ten*declslons of the Institutional 
2/ 

Support policy. — The two-tier panel system of the Scriven Team 
report Is taken to be the framework within which the Institutional 
programs will be evaluated in the NIE context. 

This paper Is based largely on the experience of one who has been 
associated with these programs from their beginning, on limited con- 
versations with other staff members In the program, and on a number 
of documents generated over several years. Assumptions concerning the 

NIE context to which the programs will be moving are derived from two 

3/ 

interim documents dated April 15, 1972 — and by a more recent organi- 
zation chart dated June 13, 1972. 

The body of the paper is divided into two major sections. Problems of 
-Transition- to-the-New-Policy-and-OrganlEation^-and-Probl^ms-of—Implemen 
ing This Year's Funding Recommendations* 



21 Michael Scriven, "An Evaluation System for Regional Labs and 
R6tD Centers," August 31, 1971. 

Daniel L. Stufflebeam, "Design for Evaluating R&D Institutions 
and Programs," August 31, 1971. 

Zj "Report on Organization and Management: An Interim Organization," 
NIE Planning Unit, April 15, 1972. "Program Planning for the 
National Institute of Education: Summary of Four R&D Analyses," 
NIE Planning Unit, April 15, 1972. 
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II. Prbbleths of Transition to the New Policy 
and Organiggtion 

A. Program Objectives ^ 

The Frye paper lists a number of objectives which are entirely accept- 
able — ^ but which are stated at a management or operational level. 
Greater coherence in the application of the new policy can be achieved 
if the fundamental policy objectives and assumptions of the institu- 
tional program a.^^ iiriginally stated are reviewed and re-stated in the 
light of current conditions. 

First of all, it is important that this program be placed in the 
context of the total national effort in educational R&D and of the 
total NIE program. Critics of the laboratories and centers have often 
appeared to start from the premise that these institutions represented 
- one or both. They do not . — Consider the- following " 

The advancement of basic research is an essential element of 
any overall plan. The fundamental strategy for its support 
has been and will continue to be the support of unsolicited 
project proposals. There are strong arguments, however, for 
supporting some basic research ancillary to programmatic R&D. 



4/ Frye, o£. cit . , pp. 4-5. It is possible that not all the objectives 
stated are compatible with each other, and the policy statement 
needs to be analyzed for the degree to which it can be expected 
to meet these objectives. 
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NIE has decided to put a portion of Its resources Into 
directed research and development to solve specific priority 
problems « Laboratories and centers vlll be significant 
competitors for such funds, but this role falls outside the 
purposes of this paper. 

NIE will havjB a variety of other programs for meeting special 
purpose needs (e.g.. Research Training, Experimental Schools, 
New Initiatives, etc.) 

The concern here, then, is with the policies and procudures which 
should govern NIE's relationship to a special set of institutions 
which have been established as a result of previous initiatives. Our 
concern is x^ith that aspect of NIE's total program which deals with 
the support of field Inltlatedi/tfrpKciBPBatoic iR&D^fa i t theii^btnatiitattotiacis > 

!• Are Specialized R&cD Institutions Needed ? Two models of educational 
reform have been operative in the past decade: 

« The Exenq[>lary Practice ^todel states that reform can be achieved 
from within. The federal government supports this strategy by 
searching for the best in current practice, often through 
formal evaluation procedures, and establishing such practices as 
exemplars for other practitioners to emulate. Such innovations 



are generally based on the experience and Insights of 
practitioners. Support for such Innovations has been 
provided directly to operating schools systems through 
such programs as ESEA Titles I and III, Bilingual Program, 
Drop Out Prevention Program, etc. It Is the basic model 
to be used by OE after the formation of NIE. 

The Research and Development Model draws upon both the wi^dos 
of practitioners, and on new knowledge as developed in the 
underlying disciplines. For the roost part R&D takes place 
outside of operating organisations. There are various sub- 
tjrpes of R&D, but a major one consists of procedures for 
taking specific improvement objectives and moving back and 
forth between the full complexity of the individual classroom 
and the oversimplified but disciplined knowledge of the labora- 
tory in an iterative manner until. a product is produced that 
achieves the objectives. Most of the programs supported under 
Cooperative Research have employed one or another sub-type of 
the R&D model. 

The case for specialized R&D institutions in education zrestaf^ 
upon the great complexity of the problems being addressed in 
education, the complexity of the R&D process, and the lack of 
existing institutions with the requisite capability. 
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The great coinplexity of social problems in general and educa- 
tional problems in particular has been commented on frequently. 
Educational outcomes are dependent upon a large number of 
individual, educational , social, economic, community, etc. etc. 
variables, and sxnali scale efforts concerned with only a few 
factors have generally been ineffective. The R6cD model there- 
fore puts a premium on large ecale efforts which tend to be 
comprehensive in scope. This requires the contributions of 
people from many different disciplines (e.g. , psychologists, 
sociologists, economists, etc.,) and technologies (e.g., computer 
specialists, graphics specialists, etc.) Not only are different 
kinds of people needed but also specialized resources of many 
kinds: computers, photographic and TV studies, experimental class- 
rooms, graphics and arts facilities, etc. Such efforts tend to 

~ - take~consider ablest ime7~typically~five-years"~or'^more7~from con- 

ception to completion. To manage such complex processes and 
resources it Is necessary to introduce sophisticated management 
systems. Such efforts cannot be mounted quickly; they must be 
institutionalized and maintained through time with some degree 
of continuity; outstanding people must be recruited and given a 
highly professional climate for work. 
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We should remind ourselves that we are dealing with tMO kinds of 

5/ 

R&D Institutions, with different geneses* The center program 
was built on the assumption that greater progress could be made 
in solving problems If resources were concentrated on a specific 
substantive mission in each institution and a critical mass of 
manpower and other resources were built up. Programs were expected 
to interrelate and reinforce each other. Laboratories had a 
different origin. They began with regional missions and. programs 
based on assessment of regional needs. Some still have a regional 
aspect, but all have come to focus on the development function 
and pride themselves on having the management capability to take 
on diverse large scale prograxmnatic efforts. Laboratories also 
have important linkages with state and local schools systems which 
give them Important diffusion and capabilities. 

With a few exceptions, such institutions did not exist in educa- 
tional research before the establishment of the Centers and Labora- 
tories. Bureaus of educational research have been common in schools 
of education, but they have either tended to be pulled into service 



5/ The National Program on Early Childhood Education (NPECE) actually 

represents a third organizational model, one involving the coordination 
of several university based R&D centers. The two vocational research 
centers were originally sponsored under the vocational education 
legislation and have a s^^lghtly different history. The National 
Center for Higher Education Management System, which exists within 
the corporate structures of the Western Interstate Commission for 
Higher Education (WICHE) , is a special case having some resemblence 




to NPECE. 
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activities at the expense of R&D, or have limited their role to 
facilitation of the project interests of individual investigators. 5i- 
Privste industry, either through its. publishing arm or more recently 
through the combinations of publishers and systems companies, has 
hestitated to underwrite the cost of testing of materials and 
may lack the ability to attract the necessary scientific talent. 
A few non-profits like the American Institutes for Research and 
the Educational Testing Service provide some of the needed capability 
but fall far short of the total required. 

The following statement of objectives has guided the Laboratory 
and Center Programs since 1966 and should be used as a point of 

7/ 

reference in reviewing the program objectives under the new policyj-*' 
Program objectives are to: 

"1. Alleviate major educational problems through large-scale 
long-term programmatic research, development and diffusion 
of knowledge, products and practices. 



6^/ Sam D, Sieber, with the collaboration of Paul F. Lazarsfeld, 
The Organization of Educational Research in the United States , 
Cooperative Research Project 1974, Bureau of Applied Social 
Research, Columbia University, New York City, 1966, pp. 93-149. 

7/ A Status Report on the National Program of Educational Laboratories , 
R&D Centers, and Related Institutions Administered by the Division 
of Manpower and Instiinitions , NCERD Air lie House Conference, 
April 14, 1971, pp. 2-3. 



Create and maintain a new infrastructure in education that 
Is needed to develop solutions to critical educational 
problems Including: 

. the development of •en«tvork;oft>ipeclmliied instlt^itions 

the definition and elaboration of the technology of 
educational research and development 

the development of an interdisciplinary pool of 
manpower akllLf^iin the prop08fit?a£ pro^MUMifetot ic 

educational research and development, and 

the development and maintenance of linkages by these 
institutions between educational practitioners, R&D 
performers, policy makers, and the sources of support 
needed to effect changes in practice/' 

To this might be added the capability for the assessment of 
needs and for identifying new problems and priorities. Given 
the decentralized and pluTealistic nature of American education, 
it is essential that a portion of the national effort be 
equally decentralized and pluralistic* 
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2, Should NIE Maintain a Special Relationship with the Laboratories 
and Centers ? Such a relationship has existed in the past and 
clearly will exist with respect to developing institutions under 
the new policy. The question is directed primarily to those 
institutionef which will be classified as mature and which will 
operate under the "program purchase" policy. Can the mature 
institutions survive under this policy if some kind of special 
relationship is not maintained, and if so, can they be optimally 
productive? 

a. Reciprocal Obligations , The concept of special relationship 
implies that each party to the relationship takes on special 
obligations,, For its part, the Office of Education has: 

. Limited competition for dollars . There was a special 
budget line for each of the two programs originally, and 
more recently a budget line for "institutional support." 
These funds could not be used for supporting R6eD other 
than at the labs and centers* 

. Backs topped the inatitutions with respect to problems 
associated with lack of working capital * 
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- Support of institutional /missions through indirect 
cost subsidies . Some other federal and private 
programs do not pay full indirect costs. When such 
additional projects have contributed to the institu- 
tional mission, OE made up the difference by paying 
those management costs not otherwise covered. Although 
diversifying the sources of support has been stated as 
a goal of the new policy, institutions lacking working 
capital resources will be unable to take on such projects 
unless ways are found to continue this kind of support. 

- Many grants and contracts are on a reiinbur semen t basis. 
This means that the unit must incur the expenditures 
first and be reimbursed later. Without reserve funds of 
some kind a laboratory could not accept such gr&nts or 
contracts. (Centers have the fiscal resources of their 
host universities behind theme but this fact also 
represents a burden and cost to the universities.) 

In return for this kind of support, the c^rtttcra and laboratorlaa 

have: 

Been responsive to shifts in OE priorities, such as career 
education, and to OE requirements such as insistence on the 
specification of development objectives* 
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Have permitted OE intrusion on internal management, have 
responded to heavy reporting requirements, and have opened 
their programs to burdensome evaluations* 

Have maintained their mission focus in spite of pressures 
to diversify their effort. 

A redefinition of the reciprocal obligations under the new 
policy for both developing and mature institutions Is 
needed. 

The Maturity Model and the Resource Building Objective . The 
current spring review is being conducted on the assumption that, 
with the exception of one of two special cases, all the labora- 
tories and centers are - or ought to be after six to eight 
years - mature institutions. How mature are they, in what ways, 
and will they be viable under the program purchase policy? 

First of all, what are the different aspects of " maturity" ? 
The maturity model underlying the support policy recognlEes 
two dimensions: the ability to formulate meaningful basic 
program plans for the conduct of large scale programmatic 
R&D, and the ability to manage such programs. The current 
review is focusing on the quality of the plans and is not 
examining institutional management capability except incidentally 
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and on an ad hoc basis: management capability has been assumed 
on the basis of past institutional assessnttents. However, pre-- 
llminary indications from the Specialist Panel phase of the 
spring review are discouraging with respect to the quality of 
many program plans » and in a number of cases the quality of 
management is being questioned also* If such evaluations are 
confirmed by . .e Master Panel » NIE will be faced with a dilemma: 
should if. let the chips fall where they may» cutting programs 
and possibly institutions where they do not measure up? Or 
should it still recogniee a government mission to build the 
infrastructure for educational R&D by attempting to nurture 
these institutions to the point of maturity? A third 
alternative would be to eliminate existing weak programs and 
institutions but to pursue the infrastructure mission through 
establishing new institutions. ^ 

c. Management Fees and Independent Research Funds . An additional 
issue concerns the fiscal viability of these institutions. 
This issue is somewhat attenuated for the centers, which are 
constituent parts of universities, although there are toany re- 
lated problems concerning the kinds of burdens that the govern- 
ment ought to place on universities, particularly at a tixne when 

8 / 

they are in financial difficulty. But the laboraterlM are 



*/ See Raymond J. Woodrow, "Government. University Financial Arrangements 
for Research*', Science, Vol. 176, 26 May 1972, pp. 885.889. See 
aLso section II. B. 6 on cost sharing. 
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independent non-profit corporations without fiscal resources 
of their own. This means that they have no way of keeping 
staff between contracts t no way of accepting cost reimburse- 
ment contracts; no way of accepting (grants or contracts that 
do nit pay full indirect costs, no way of paying for kinds of 
costs that are not allowable under government cost principles » 
no funds to cover the costs of proposal writing, and no in- 
dependent research funds to support the project ideas of 
creative staff roenibers. The management fee and independent 
research funds proposed in the Frye paper are absolutely 
essential components of the program purchase policy, and neither 
the policy not the Inatltutticma #rc vtWite '«ittll<*arid «lt»— it>r»>e 
fees are given official sanction and built into the funding process . 

Hoy can NIE best support improvements in the field of R&D management 
and the technology of educational development ? l\XE has recognited 
a major objective of continuing to build the infntetructure of 
educational R&D through the establishment of a Bureau of Resources, 
Prior to the establishment of the laboratories and centers there 
had been little attention to the technology of development (except 
perhaps in the course content improvement movement) » and because of 
the small scale of most educational research the field of research 



«15. 

tnanagement was not very sophisticated. The laboratory and center 

programs can claim to have made considerable progress in these 
9/ 

fields,— although much remains to be done. The move to the program 
purchase philosophy should not signal a loss of concern for these 
fields; they are an essential part of NIE's resource building 
mission. It is proposed that a unit be established within the 
Bureau of Resources to support research and development on R^ D 
management and the improvement of the technology of education 
development . A number of suggestions for needed work in these 
fields are contained in a recent draft report sponsored by the 
National Academy of Education, — ^ 

4. How can the proper balance be achieved with respect to a ntomber of 

policy dilemmas? Many of the problems of transferring these programs 
and implementing the new policy can be seen in terms of a series of 
policy dilemmas* Putting these issues In the form of polar opposltes 
does not imply that a choice must be made between the opposltes, 
but rather that NI£ mu^t find the right balance along the rfimertsions 
thus defined. 



9/ See for example the four volume Policies and Procedures Checklist 
written by the laboratory and center business managers and articles 
by Richard Schutt and John it. Henphill In the Journal of Research 
and DeveloOT>ent in Education , of Georgia, Vol. 3* No. 2, 
Winter. 1970. 

10 / J. Victor Baldrldge and Rudolph Johnson, The Iiqpact of Educational 
R&D Centers: An Analysis of Effective Organisational StrategleiT ] 
February 1, 1972, mimeographed* 
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Flexibility vs. Continuity , The nature of programmatic R&D 
is such that major efforts typically take a minimum of five 
years from conception to product completion. No results can 
be achieved unless the agency is prepared to support such 
efforts over the required time span* On the other hand, in 
times of rapid social change and with the turnover of agency 
administrators 9 priorities for R&D tend to shift and there is 
always a search for new initiatives. In time the new policy 
i6 expected to provide some solution to this dilemma inasmuch 
as (after the first year or so) some programs will be completed 
each year thus freeing funds for new Initiatives* This may 
help, but there are also dangers involved. If the new prlprlty 
is radically different from the completed program, the funds 
may well be shifted away from one Institution and given to 
another. Thus we may be establishing a reward structure which 
is in fact a punishment system: your reward for successfully 
completing a program is to lose your sxip^ort for further work. 
The capability in the first institution may consequently be 
destroyed and be unavailable should a new need arise in that 
field. Is NIE willing to pay anything for the maintenance of 
in^place capability in the major mission areas of educational 
R&D? 
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Mission Focus vs> Conglomeration > The R&D centers were 
founded on the basis of the ''critical mass hypotheses" » i.e., 
they were intended to toove beyond project research and focus 
resources on large scale programmatic efforts; payoff was 
expected from having scientists and scholars from different 
disciplines and fields working together toward common objectives. 
Most centers have also operated at lover budget levels than 
laboratories y reinforcing the need for concentration of resources. 
It is important to maintain a press on institutional mission 
for the centers because of the strong tradition of individualism 
among professors. Some of the more successful laboratories 
have not had a substantive mission focus but are conglomerates 
in the sense that their several progrems do not relate to or 
reinforce each other. This does not necessarily negate the 
critical mass hypothesis since these tend to be large labora- 
tories that probably have a critical mass within each program* 
Since some institutions are successful without having a mission 
focus it does not s^em wise to press all institutions to have 
one; but it is awkvard to press acne and not others unless there 
is some differentiation of objectives %rhich would Jutify it. 
Note that both centers and laboratories currently have mission 
statements written into their scope of %fork. If such mission 
statements are to be retained under the program purchase 
philosophy it muBt be on the basis that some special relation- 
ship still exists. 
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Research vs. Development , Preliminary rc^ading cf the Specialist 
Panel reviews indicates some dissatisfaction with the amount 
and quality of research in the labrj and centers and an apparent 
over-emphasis on development. The center program has always 
emphasized both functions , although only a few of the centers 
have managed to move beyond prototype development (in part 
because budget levels would not permit). However » NCERD 
pressure over the years (partly in response to pressures 
from elsewhere for more immediate results) has emphasised the 
need for building prcgritms around development objectives. The 
labs have focused on development as their central function 
since about 1967-68, Present guidelines and the support policy 
itself are aimed at development and do not fit research programs 
readily. The Specialist Panels may well be right in recommending 
a re-legitimation of the research function. But if this is * 
done, the following cautions should be observed: 

Labs and centers should not be punished for being responsive 
to past 0£ pressures toward development. 

The guidelines and assessment criteria should be adapted 
to place a higher value on research. 
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Over the past few years there has been a tendency to merge 
the laboratory and center programs despite their very 
different organizational base, financial structure, and types 
of personnel. Perhaps before this merger is conq>leted some 
thought ought to be given to permitting some degree o f 
dlffTmntlmtloa of the purposes^ missions, and functions 
of these two kinds of organigattons . 
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B, Program Management . 

Whereas Section II,A« above dealt essentially with ends, the present 
section will concentrate on means. Listed here are the broader issues 
of implementing the policy in a new organisational setting. A 
number of more immediate "nitty gritty" problems are taken up in the 
following Section III: 

1. How will the implementation of the policy be coordinated through 
the various organizational units of NIE concerned with labora^ 
tories and centers ? According to the interim organizational 
plan, the Developing Institutions Program will be in the Bureau 
of Research and Development Resources, while (most?) purchased 
programs will be in two different divisions of the Bureau of 
Educational Systems. Responsibility for evaluation is 
apparently lodged in an OPPE unit. The new policy is built on 
the assumption that uniform policies and procedures will be 
applied to lab and center programs regardless of where they are 
monitored. How will this coordination be achieved ? Also, 
decisions made about individual programs may cumulate to the 
point of having major effects on the institution . Is there 
any unit in NIE which will be concerned with the labs and 
centers as institutions which will review the cumulative effects 
of individual program decisions? It has been assumed that there 
would continue to be a master institutional contract so that 
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all programs would operate under standardized terms and 
conditions. Who would be responsible for such institutional 
contracts and how would they relate to program monitors? 

2. V?hat steps will be taken to complete the design of the 

assessment system for the new policy ? The assessment system is 
still incomplete. The "Spring Review" ts not a system for man- 
aging the programs under the new policy but a one-tine event 
covering the transfer of the programs from the old to the new. 
The framework for the assessment system needed is contained in 
the ten decisions identified in the Frye paper. The report of 
the Scriven Team^— ^ is the first chapter in the development of 
the system, but does not purport to be more. The report of the 
Stufflebeam Team contains more detailed procedures and is in 
large part compatible with the Scriven framework. The spring 
review, including the work of the Specialist Panels, the 
Synthesis Panel, and reports by consultants, advisors and staff 
have produced a number of insights, procedures, and documents 
which would be useful in developing the final assessment system. 
An early priority for NIE should be to complete the development 
of the system, building on the work that has been done to date. 
Part of this task should Include the specification of how the 

XJ/ Scriven, og^, cit . 
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responsibility for the different parts of the system are to be 
divided amonK organizational units. For example, the Master 
Panel will presumably work with the Program Evaluation Unit. 
Will there be Specialist Panels? If so, will they also relate 
to the Program Evaluation Unit or to the relevant task force or 
division? How will the monitoring role be differentiated from 
evaluation? Is thie a meaningful distinction in organizational 
units with a substantive focus and staffed with substantive 
experts? etc. etc. 

3. What policies are needed with respect to the relation of other 
NIE programs to laboratories and centers ? In the past other OE 
programs have sometimes been reluctant to consider proposals 
from laboratories and centers, or to pay full indirect costs 
for proposals funded. If mature institutions are to be given 

a more independen^ status and encouraged to broaden their base 
of funding, they must be given equal opportunity to compete for 
other funds both in the unsolicited and directed program. And, 
as explained elsewhere, since the laboratories have no working 
capital, other programs must pay full indirect costs, 

4. How can the long-ra\ige commitments resulting from the program 
review process be built into the agency budgeting process ? 
Multi-year consnitments are an essential part of the new policy. 
Unless a move is made to full funding programs (which is 
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unlikely under ptotpcetlve budget levels) « these commitments 
are of course dependent on ccmgresslonal appropriation of funds* 
These future year commitments are not necessarily for level 
funding; program costs rise and fall at differ^ul stages of the 
research and development cycle. The commitments will not mean 
much unless the agency builds the continuation costs into its 
budget requests. This is a problem of immediate urgency. As 
explained in section III.F. there is reason to doubt that the 
FY 73 budget request adequately reflects program needs. In 
addition, this is also the season for building the FY 74 budget, 
and procedures need to be established for moving from the funding 
decisions on the Basic Program Plans now being reviewed to the 
budgeting of continuation costs for FY 74. 

Having stated this as to how the system ought to work, it is 
necessary to identify a problem in making it work. The budget 
justifications in the BPP's are not as strong as they might be, 
especially beyond FY 73. Requests for more budget detail were 
deleted from the BPP guidelines, and consequently the data base 
for the Master Panel's consideration of program costs is not as 
good as would be desirable. Nevertheless they constitute the 
best estimates available, and should be used in the budget 
making process. 
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5. How will the diffusion of laboratory and center products be 
budgeted, organized, and managed ? The Frye paper discussed 
this issue and concludes that there is no sharp break between 
the R&D procfcao and the diffusion stage.^-' Inevitably the funding 
of R6cD requires the funding of some activities which anticipate 
and prepare for the diffusion stag^« It is quite possible and 
desirable to make separate funding decisions for the development 
of a product and for its diffusion, but there should be no 
assumption that the developer does not have ^'h important role 
?:r? play in diffusion process. Diffusion is an expensive process, 
and there need to be ways of supporting it without deleting the 
money from the support of R&D, Nw that NIE has been given 
clear responsibility for dissemination and diffusion and the pro- 
grams of the National Center for Educational Conrounicatlon (NCEC) 
have been transferred to it, new ways of integrating these 
processes need to be worked out. Past programs of NCEC have been 
helpful, but some suggestions should be made: 

. EstablishmentLof a separate NCEC in the OE context implied 
a "hand it on** philosophy, i<,e,, the product will be supported 
and developed in one part of the system and then ''handed on'* 
to other agencies. This may be appropriate in some situa* 
tions, but clearly is not in others. NIE units responsible 

12/ Frye, o£. cTt . , pp. 30-33 
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for support of product dcvclopcftcnt in tubttantlve areas 
nect' ^o be able to loove l2)to the diffusion stage as veil. 

There is a need ior centralised dissemination services wuth 
as the Publishers Alert, the Product Display, and PEP. 
However, too often these services vere developed without 
adequate participation by the programs affected In NCERD. 
Liaison needs to be improved. 

For the past two years NCEC has let a contract to hold a 
competition among developed products for award of limited 
funds for diffusion assistance. Such an approach may be 
required because of the lack of adequate funds to do !!^re, 
but it meens that the vast majority of developed products 
sre not receiving such assistance. Such an approach 
increases the danger that developed products will not find 
their way into us€, and that the UD investment will be lost. 
Clearly an appeal needs to be made for greatly increased 
diffusion funds. 

Should NIE continue to repuire that universities cost share in 
the support of R6d> Centers ? This has bv^en required heretofore 
and is embedded in the policy of the Cooperative Rei^^^ch Pro* 
gram, %i^ich was founded on a grant philosophy although it has 
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often used the contract instrument. The requirement had to 
wsived for the laboratories since they have no resources of 
their own, although the programs su'iportcd in laboratories have 
also been f ield^initiated. Many universities want to cost- 
share because they prefer to have their major faculty members 
on "hard" money. As the policies and procedures for the two 
programs have been tending to become melded into one, the issue 
arises whether the Government can require cost-sharing of one 
and not the other. This may be a further argument for retaining 
and even augmenting some differentiation in thu^ mission of lab - 



oratories and centers ^ (See also section II. A. 4c.) 
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III. Problems of ImplcTnert ing FY 73 Funding Recommendations 
IVliile specific funding recorniTvindat icns for FY 73 are not known at 
this time a number of problems can be anticipated in translating 
funding recomendations r/nd (Jecisiovis into negotiated contracts 
by the end of the contract year on November 30. 

A, Chtgcking Funding ReconCT/mdations for Consistency with Program 
Pol icy . 

To some ^eiitent: 1 1 might be argued that the current review is taking 
place in a policy "^acuum. The Frye document is being used as the de 
facto policy, but it lacks the official sanctdion of NIE decision 
makers or publication in the Federal Register. Worse, with the 
exception of a few Individuals, the members of the Specialist Panels 
and Master Panel have little ))cnowledge of program history or objec- 
tives. This has led to the confounding of a number of elements 
that shciild have been kept separate in the review. For example, 
some Specialist Panels have rated programs partly on the basis of 
technical quality and partly on tlieli perception of the priority of 
thc^problems attacked. If the Master Panel or NIE decide on dif- 
ferent priorities, they would presumably have to rate the programs 
differently. Also, if Specialist Panel recommendations are 
followed in detail some of the institutions will not survive. In 
these and other areas it is important for NIE to make a determina- 
tion concerning its policies for the laboratories and centers. 
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ITiis means thai a negotiation which is more of a give and take 
process would need to take place, and it should occur before the 
institution submits its ABJ.~ There must be staff members on board 
in NIE who are familiar with the program and the review process that 
has taken place, understand the reconimendations , and who can conduct 
this negotiation. Advisors and consultants cannot do this job for 
VilE, Some early staffing decisions in NIE therefore become essential. 

C, Contract/Grant Terms and Conditions . 

At the present time there are 20 contracts and 3 grants with 8 R&D 
centers, 11 laboratories, 2 vocational research centers, and 2 other 
entities. The special terms and conditions are keyed to relation- 
ships to these as institutions. There are some differences for 
laboratories and centers based on the fact that laboratories are 
independent non-profit corporations while centers are constituent 
parts of universities. Hie following are some of the issues which 
should be addressed: 

I. Should the grant or contract instrument be used ? Under what 
conditions? For all kinds of institutions? What historical 
factors need to be taken into account (e.g., university policy 
on cost- sharing under contracts)? 



Ijy cf. A Scriven , pp. 3-4. 
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2 . l^at dlfferencefi in termo and conditions are requ i red for 
university centers are non»proflt laboratories ? Centers are 
tied to university accounting systems, salary schedules, and 
regulations, and it is difficult to impose conditions which are 
incompatible with these. 

3. Should new contracts or grants be written , or should existing 
instruments be modified and continued? If new instruments are 
written, will this eliminate the possibility of carrying over 
unexpended funds, or can this loss of program money be avoided 
in some other way? 

4 . Should developing insti tutioi^s and mature institutions be 
treated differently , either in the choice of grant or contract 
or in specific terms and conditions? This is a complex issue* 
In a sense developing institutions will be given more general 
"institutional" support, which would imply the use of a grant. 
However, monitoring is expected to be close, for which a con- 
tract would be more appropriate. Mature institutions will be 
operating on the basis of specific program plans, but the fact 
of their maturity should lead to a relaxation of the monitoring 
relationship . ITiis does not mean a relaxation of their account- 
ability, but rather that they might be relieved of (a) detailed 
reporting requirements, (b) the need to seek contracting officer 
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approval for some kinds of actions for which it is now required, 

(c) evaluation of their management, etc. Cuch a change for 

IV 

mature institutions is implied by the policy paper,— ' seens 

15/ 16/ 
intended by NIE planning documents, ~ and is pi^rt of KEW policy.— 

A related ist^ue is the need to move to closure on the 
classification of institutions as developing or mature . The 
spring review is taking place as if all institutions were mature 
although at least some ought to be classified as ''developing." 
Developing institutions require different evaluation criteria 
and monitoring procedures as well as different contracting pro- 
cedures. The developing institutions program should not become 
a dumping, s^round for weak institutions but should be established 
with reference to clear Agency objectives. 

Among the terms and conditions that need to be reviewed are the 
following: 

. Period of performance 

. Fiscal reports 

. Reports to be furnished 



14/ Frye, op. cit, pv 35.' 

15»/ Report on Organization and Management; An Interim Organization , 
National Institute of Education Planning Unit, April 15, 1972, 
pp. 19-20. 

16/ A Program for Improving the Quality of Grantee Management , 

Financially Independent Organizations, Vol. I, and Financially 
Dependent Organizations, Vol. II, pp. 1-2, pp. 57-58. 

ERIC 
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. Contract related income 
. Reprograrnming funds 

. Copyright policy (note that we have operated under what is 

specifically an OE policy, not an HEW policy) 
. Method of payn\ent 
. Indirect cost subsidies 

. Institutional mission statement and scope of work (see also 
section II.A.A.b. ) 

Perhaps the scope of work deserves special comment. Under current 
contracts the scope tends to be very detailed concerning each step 
of the process. In effect the institutions are being monitored with 
respect to both means or process and achievement of objectives. One 
of the implications of the new policy is that for mature institutions 
there should be less concern for means or process and more with the 
intermediate and ultimate objectives. Among the things we need to 
learn to do. better are how to differentiate between m©ana. »nd d 
ends, how to write the specifications for the ultimate outcomes in 
educational terms, and how to identify major milestones along the 
way which either represent the achievement of sub-objectives which 
are ready to be evaluated or which represent important decision 
points. In a programmatic effort-' the means may have to change in 

\ll For the difference between program management and project 

management see John K. Hemphill, "Management and Operation of 
Educational Laboratories," Journal of Research and Development 
in Education , Vol. 3, No. 2, Winter 1970, pp. 65-80. 
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the light of emergent results; a mature institution should be allowed 
to change its approach if its initial approach does not yield the 
expected results. What counts are the final outcomes. The contract 
scope of work is the means for establishing accountability for the 
program; it should include items which are essential to that objec- 
tive and exclude those which are not. 

It is highly desirable that the terms and conditions be reviewed 
and revised through a genuine process of negotiation and not by uni- 
lateral Government action. Government officials are often not aware 
of the full implications of changes and their impact on the costs and 
functioning of the l^iboratories and centers. For example, changes 
in budget requirements may cause expensive changes in accounting 
systems. NCERD has established working relationships with the 
organization of lab and center business officers, and meetings with 
this group have often proved useful. During the past year the 
business managers produced a four volume set of "Policies and Pro- 
cedures Checklists'* governing the internal management of their 

institutions which are geared in many respects to current contract 

18/ 

terms and conditions.— It would be important to study these volumes 
while reviewing the terms and conditions. 
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There is another set of terms and conditions vhlch are not so nnjch 
at the discretion of the individual program but are mandated by 
reKulations at higher levels of HEW, the executive department, or 
by Congress. Whatever their other virtues, a number of these are 
counterproductive with respect to the efficiency and effectiveness 
of the programs in laboratories and centers. Although it may not 
be within NlL's power to change them, as a new agency with new 
policies It should make a carefi I study of these regulations and 
their effects on programs with a view toward seeking modification 
or elimination of the regulations where appropriate. Although 
this is not the place to go into details, NCERD has already done 
staff work on a number of these issues. Examples include the 
following: 

« Printing and binding regulations 

. Forms clearance and protection of human subjects 

. f^qulpment and data processing 

, Setting up revolving funds 

. Use of the FTS network 

, Authorization for production of films or other media products 

. Title to property 

. Model Cities certification 
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D. What kind of new budget structure Is needed to acconmodate the 
new policy? 

It Is not possible to go Into detail here, but the new policy would 

have many implications for the structuring of budgets and accounting 

systems. These would of course differ for developing and mature 

institutions. Different kinds of costs need to be sorted out as 

direct, indirect or other costs. The management fee and independent 

15/ 

research funds are Intended to cover the "other costs. The 
allowability and handling of a number of kinds of costs covered in 
the past need to be reviewed, for example, costs which support an 
institutional mission but are not attributable to any one program; 
costs of maintaining linkages with state and local schools systems; 
costs of developing new program ideas, etc. 

E. Sole Source Procurement and Long-*Range Commitments . 

There has been increasing concern whether specific procurement actions 
adequately reflect the need for corapetltlcn, or conversely whether 
they have an adequate justification for sole source procurement. 
The present review is largely (although not entirely) of continuing 
programs, and all are competing with each other. In the future new 
programs may be initiated individually. Again, we have the issue of 
the special relationship and the degree of competition needed. The 
new policy and assessment system Involves review of and commitment 

ig/ For the rationale behind establishment of the management fee and 
independent research funds, see Frye, og^. cifc . , pp. 18-24. 
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to imilti-year program plans. How can that commitment be established ' 

contractually? Can full funding or any degree of nniltl-year funding 

be established? Will the sole source Issue be avoided on contlnua^ 

20/ 

tion In subsequent years ."^ 

F. Meeting the Increased Cost of the New Policy . 
According to the new policy, when an Institution attains mature 
status and comes under the program purchase philosophy It is eligible 
to receive a management fee and funds for Independent research. As 
explained elsewhere, these additional costs are considered essential 
to the viability of both the new policy and the institutions it 
covers. Yet apparently no provision has been made for these Increased 
costs in the projected FY 1973 budget for NIE . Indeed, the figure 
presented for Institutional Support, $32^100,000, while apparently 
intended as a level continuation, actually represents a substantial 
cut in funding for laboratory and center programs. As explained 
in the attached table » lab and center programs were actually funded 
out of three budget lines in FY 72: institutional support ($32. IK), 
vocational /research ($2,77K) and general R&D ($l,dK). Thus, $35.87K 
would be required to continue these programs under the old policy. 
If the costs of the management fee and Independent research are 
added, nearly $40K would be required. (If the research centers 



ZQf The OE Sole Source Board initially wished to review continuation 
funding for lab and center programs, but when the first test case 
came before it, the Board decided that continuations did not need 
to be reviewed. 
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from the education of the handicapped are Included, the figures are 
correspondingly higher.) It will be very difficult to gain accept- 
ance of the new policy^af- the laboratories and centers must first cut 
their programs because adequate funds for level continuation are not 
available, and then must cut again to absorb i.he costs of the manage- 
ment fee and independent research « (Of course none of this takes into 
account that with inflation, level funding means a decrease in total 
effort. ) 

G. Cost Problems Facing the Master Panel . 

There are several other problems dealing with cost which are not so 
much problems of implementing the Master Panel recoramendations as 
problems which the Master Panel should consider in arriving at its 
recommendations . 

1 . The FY 73 cost of programs not recommended for funding Is not 
zero except in the case of the few proposals for new programs. 
It is usually desirable to bring the work to some point of com- 
pletion, to meet personnel commitments, etc. In the past close- 
out costs have been up to 50% of the prior year costs over a 
six-month period. Quite possibly such costs could be lowered 
considerably in the future ^ but not to zero. 

2 . The Master Panel should be making recommendations about multi-year 
commitments . If not, the implementation of new policy should be 
postponed. 
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It vould be desirable for the Master Panel to use the FY 72 
funding level for each program <m8 a point of reference . Many 
programs may be requesting budget increases which can ^e granted 
only at the expense of eliminating another program, and the 
trade-off may or may not be worth it. 

Indirect costs may have been under -budge ted by laboratories and 
centers . The program purchase policy requires more sophisticated 
and expensive accounting system for segregating costs by program. 
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IV. Conclutlon 

NCERD has been moving vigorously for over « ye«r to fonaul«te « 
new Institutional support policy «nd design «n Assessment system 
keyed to the new policy* Ihc work was originally predicated on 
the agguroptlon that NTE vould come into being in the Fall of 1971. 
When the passage of the nev legislation was considerably delayed, 
NCERD continued its movi^ent tovard the nrv posture by implementing 
a full-scale revlev of laboratory and center programs by a series 
of Specialist Panels. It has discharged its responsibilities and 
paved th«* way for the NIE takeover vlth the assumption of the reports 
of the Specialist Panels on June 30. 

The most crying need at the present time is for NIE to <ro»e Into 
full being, staffed vlth people vho have complete authority to act 
for the new agency, NlE needs to move to closure on the nev i>ollcy 
and publish the new rules and rejgulations in the Federal Register . 
This step is prerequisite to everything else, for everything else 
should flow from policy. It is then necessary to legltimice the 
spring review as it has taken place to date and is continuing and 
to move to more specific aspects of implementation thrcxigh 
establishing the necessary organicatlons and procedures. 

Some difficulty has already bein caused by the fact that things have 
gotten out of sequence. For examiple, the assessment tystem v4«slgn 
called for the Master Panel to be established first, with the 
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Specialist Panels to act as the "eyes and ears" of the Master Panel. 
For unavoidable reasons it happened the other way around, and the 
Master Panel is now trying to catch up with what has been going on. 
Now that NIE has been established it is very important that the pro- 
gram steps be put back in proper sequence, with the flow being from 
policy to procedures. Undue haste should be avoided . It would be 
disastrous to move any further on the ai^sumption that we know what 
the new policy is; the new policy must be fully legitimated by the 
new NIK Director and his Council by whatever means are appropriate. 
Otherwise we run the risk of leaking changes in program management 
that have a major impact on the nature of the program and the 
viability of the labs and centers only to find that the policy isn't 
what we thought it was. 

Hie present paper has attempted to identify a number of issues 
concerning the transfer of the laboratory and center programs to 
NIE without in any way trying to provide all the answers. These 
issues deserve careful study by people who can bring a variety of 
skills and experience to bear on them. There is no reason why this 
study should not begin immediately with the understanding that 
closure should not be reached until the more fundamental policies 
have been decided. It would be unwise to assume that everything 
must be settled in the next few weeks and incorporated immediately 
into the FY 73 contracts and grants. Rather, FY 73 should be con - 
sidered a vear of transition during which NIE moves carefully and 



.41- 

deliberately to establish the program on a firm footing which will 
last for a reasonable number of years and not be subject to 
immediate demands for change. 
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Attachment A 



FY 73 Funding Requirements for Level Continuation of Lab-Center Purchased 
I' ro;;r.ir7is and Developing Institutions 



DRDR Program by 
Budget Source 


Total 


Program 


Indep . 
Res. (a 8% 


Mgtnt. 

Fee @ 37o 


A. Total DRDR 

1. Inst. Support 

2. Voc. Ed. 

3. Gen'l RfiJD Development: 

4. Handicapped 

B. Developing Institutions 

1. Inst. Support — 

2. Voc. Ed. b/ 

3. Handicapped 

C. Purchased Programs 

1. Inst. Support 

2. Voc. Ed. £/ ^ 

3. Gen'l R&D Development- 


$40,368,200 


536,670,000 •. 


1^2,689,600 


$1,008,600 


35,433,000 
3,025,200 
1,110,000 


32,100,000" 
2,770,000 
1,000,000 


2,424,000 
185,000 
80,000 


909,000 
69,600 
30,000 


3,050,000 


3,050,000 


- 


- 


1,800,000 
450,000 
800,000 

37,318,200 


1,800,000 
450,000 
800,000 

33,620,000 


2,689,600 


1,008,600 


33,633,000 
, 2,575,200 
1,110,000 


30,300,000 
2,320,000 
1,000,000 


2,424,000 
185,600 
80,000 


909,000 
69,600 
30,000 



£/ NPECE and a new institution, 
b/ North Carolina State 

£/ Ohio State. Does not include $465K program now funded and monitored by 

Career Education task force, 
d/ WICHE/KCHEMS: $1,000,000 is the 12 month cost of the program funded for 

approximately 9% months in FY 72. 
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